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ABSTRACT 

The research project reported in this paper had two 
aims: to demonstrate what standard multiple-choice questions and two 
new varieties (multiple-choice cloze and guided summary test and to 
assess whether the new formats test the same skills. To find out what 
the various question formats test, the study looked at a battery of 
tests, each of which was aimed at testing a different factor that 
might contribute to reading comprehension. Factors that are not 
intended to be measured by exam questions, such as non-verbal 
intelligence and topic knowledge were included as well as the known 
components of a model. In the first of two experiments, 500 pupils 
took the whole battery and 1 of the 2 multiple-choice formats. In a 
second experiment, a smaller group took a selection from the battery, 
multiple-choice items and a guided summary. Latent correlations 
between the tests in the battery demonstrated that there was more 
coherence among the tests of reading comprehension components than 
between these and the tests of topic knowledge and non-verbal 
intelligence. Differences in the content of the three question 
formats were not found. Each question format correlated to roughly 
the same amount with all the reading/comprehension abilities. The 
multiple-choice cloze, however, exhibited consistently lower 
correlations than the other question formats. (Author/JL) 
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Abstract 

The research project reported in this paper had two aims: demonstrating what 
exactly the standard multiple-choice questions and two new varieties 
(multiple -choice cloze and guided suimary) test and whether the new formats 
test the same. 

What the various question formats test was measured by a battery of tests 
each of which was aimed at a different factor that might contribute to 
reading comprehension. Factors which are not intended to be measured by exam 
questions, such as non-verbal intelligence and topic knowledge were included 
as well as well the known components from the model of Canale & Swain (1980) . 
In the first of two experiments 500 pupils took the whole battery as wel as 
one of the two multiple-choice formats. In a second experiment a smaller 
group took a selection from the battery, multiple -choice items and a guided 
summary. 

Latent correlations between the tests in the battery demonstrated that there 
was more coherence among the tests of reading comprehension components than 
between these and the tests of topic knowledge and non-verbal intelligence. 
Differences in the content of the three question formats were not found. Bach 
question format correlated to roughly the same amount with all the reading 
comprehension abilities. The multiple -choice cloze however exhibited 
consistently lower correlations than the other question formats. 
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1 Introduction 



Until recently the form and content of the central part of the Dutch 
examinations for the modern languages in general secondary education have 
been fairly constant. The exams tested only reading comprehension and did so 
by means of 50 multiple-choice questions in total concerning four or five 
texts. The exam papers are produced by Cito -in cooperation with teachers. 
Cito-policy has always been to demonstrate that the standard multiple-choice 
format produces reliable as well as valid tests. The issue of validity has 
been of particular interest, not only because teachers feel uneasy about 
multiple-choice questions, but especially because the exams proved to have an 
enormous backwash effect. Exam papers are frequently or very frequently used 
by almost all teachers in upper secondary education as testing materials, and 
by at least half of them as teaching material, although they do not rate this 
material highly (v. Els & Buis 1987; Evers a.o. 1989). In view of the low 
ratings of exam papers (as teaching materials) we've felt compelled to 
demonstrate their validity as testing material. On the other hand, we decided 
to try and diversify the question format, offering a more attractive variety 
of questions which would fit in better with class practice and still test the 
same construct. A first diversification consisted of the introduction of 
multiple-choice cloze items. (Apart from the question format there have been 
other changes, such as the introduction of authentic functional texts with 
items in the mother tongue for lower secondary education, and a growing 
number of more varied texts for upper secondary.) 



R«lat«d lit«r«tur« 

In former research exams had been analyzed and described in terms of separate 
skills (Maas-de Brouwer & Samson-Sluiter , 1981) . As it proved to be difficult 
to distinguish these skills, in research, but even more so while describing 
the content of items during exam constrv^ction, it seemed advisable to change 
to the more flexible model introduced by Canale & Swain in 1980 and generally 
used (in many forms) since. This research is not intended to solve 
theoretical questions about the existence of or hierarchical relations 
between components in this model . 

To demonstrate whether certain question formats are valid means of testing 
reading comprehension, a clear and generally accepted definition of the 
construct is required. Attempts to have authorities and language teachers' 
organisations make a choice from the more prominent theories about reading 
comprehension have not been successful. The common tendency among them was to 
include as many theories as possible. This meant that our research could not 
compare the exams with a well defined criterion. This has led to an approach 
in which a wide range of factors was included most of which are generally 
thought to be related to reading comprehension. The factors related to 
reading comprehension were primarily oased on the components in the model of 
Canale & Swain. To these components topic knowledge has been added, because 
this has been demonstrated to be related to reading (Anderson, 1977; Peeck 
1979) , but is thought to be unfair and therefore undesirable to be tested in 
a central exam of a foreign language. To check whether the emphasis in the 
exam questions is on language, a test of non-verbal intelligence was also 
added to the battery (Groot & Bekkers 1987) . 



2 Method 

The battery of tests for the various factors was administered together with 
exam items in their traditional and in two alternative formats in two 
experiments . 
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In a first experiment, all pupils took all the tests in the battery and 
either the multiple-choice or the multiple-choice cloze version of the same 
three texts. The battery was first analyzed separately, to check whether the 
tests were psychometrically sound and whether they showed the expected 
correlation pattern. Then they were compared with the results on the two 
question formats. 

In a second, much smaller, experiment only the factors that had turned out to 
be relevant to reading comprehension were tested and compared with multiple- 
choice items from the most recent exams and with guided summary tests. 



2.1 Subjects 

Data on the mc-formats were collected in the autumn of 1990 among 856 pupils 
from the highest two forms of pre-university education (5VWO and 6VWO) . From 
these only the results of 4 97 pupils having answered items on all tests in 
Che battery have been used. Data on the guided summary were collected on a 
much smaller scale in the autumn of 1991 among 132 pupils from the highest 
form of both types of upper secondary education (5HAVO and 6VW0) . 



2 . 2 Materials 

The following tests have been constructed or selected for the test battery: 

llngulstic/graamatical co»pon«nt 

vocabulary without context, form A containing words from the texts with 

mc- or mc cloze items, form B containing a general selection of words from 

frequency lists and vocabulary lists; 

grammar /syntax; 
textual conponant 

relations between sentences and between larger parts of the text; 
•ociolinguistic coBqpon«nt 

questions on writing goal, use of tone and style, and target audience; 
atratagic coaaponant 

deriving the meaning of words from the context; 

deducing the meaning of words from their components; 
topic knowladga 

questions about the subject of the texts (before reading) ; 
non-varbal intalliganca 

Wiener Matrizen: ordering and completing visual structures. 

The question formats were the following: 
standard multipl«-choici» 

29 multiple-choice items from exams 1983, 1987 and 1988 

20 multiple-choice items from 1990 (the same format but with slightly longer 
passages) 

multipla-choica rational cloza 

54 multiple-choice cloze items with the same texts from the exams 1983, 1987 
and 1988 
guidad aunmary 

two summary tasks, each with a fairly long text (see handout). 



2 . 3 Procaduraa and analyaaa 

Mid 1990 most of the newly constructed testing material was pretested. Only a 
few modifications proved to be necessary. In the autumn the first 'experiment 
was carried out. Half of a group of approximately 1000 pupils answered 
traditional multiple-choice questions, the other half multiple-choice cloze 
iwems concerning the same three texts. Both groups took all t.he tests in the 
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battery. The total testing time was 6 teaching periods, in clusters of two 
periods . 

For the analyses only the results were used of the 497 pupils who answered 
all the questions from the test battery as well as from their reading 
comprehension format. A few psychometrically unsound items have been removed. 
First, reliabilities and difficulty indices were computed for all tests. 
Next, latent correlations were computed between all tests in the battery. 
This involved weighting items within these tests to obtain satisfactory model 
fit. Finally classic correlations were computed between question format and 
the other tests. 

The second experiment took place in the autumn of 1991. This time the pupils 
answered multiple-choice questions from recent exams and wrote gu* ^^u 
summaries of two other texts . A specimen summary with explanation and marking 
scheme was provided so that teachers and pupils could acquaint themselves 
with this format. The summaries were marked by the teacher or by a Cito 
specialist using marking schemes. All pupils also answered questions on the 
tests from the battery that had proved to be relevant to reading 
comprehension. The vocabulary test from the first experiment, which contained 
mostly words from the texts used with both question formats, was replaced by 
a random vocabulary test. The number op pupils was considerai>ly smaller, 
especially the number of pupils writing a summary. After removing incomplete 
data, only 100 pupils remained for the correlations with the multiple-choice 
test and 80 for the guided summary. Testanalyses and classic correlations 
between question format and battery tests were produced. 



3 Results 

Tab«l 3 . 1 corrslatione among factors 



group 1 (n=234) 





1.1 


1.2 


2 


3 


4 . 1 


4.2 


5 


6 


1 linguistics 

1 . 1 vocabulary 

1 . 2 grammar 


.52 


.52 


.38 
.51 


.48 
.33 


.48 
.43 


. 50 
.40 


- .01 
.02 


.02 
-.16 


2 tsxt structure 


.42 


.45 




.39 


.35 


.41 


.17 


.04 


3 sociolinguistics 


.51 


.44 


.46 




.34 


.47 • 


.12 


.08 


4 strstsgiss 

4 . 1 word building 

4.2 meaning from 
context 


.47 
.45 


.38 
.44 


.40 
.58 


.34 
. 48 


.44 


.44 


.17 
.13 


.06 
- .01 


1 S topic knowledge 


-.07 


-.14 


-.04 


. 05 


-.04 


.05 




.15 


6 non-vsrbsl 
1 intslligsncs 


.07 


-. 02 


.09 


. 04 


. 03 


.15 


. 07 





grroup 2 (n^263) 



Tabel 3.1 shows to what degree the factors cluster together. All correlations 
were computed twice, once for each of the two groups in experiment 1. The 
upper right hand section contains the correlations in group 1, the lower left 
hand section (in italics) those for group 2. 
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As the correlations were computed for scores on a latent (IRT) scale, they 
were not influenced by the usual attenuation effect. 



The general picture is clear: topic knowledge and non-verbal intelligence do 
not correlate with the factors based on the components of language 
proficiency nor with each other. These "reading comprehension factors" 
exhibit medium correlations. Note that correlations between two tests within 
one component (e.g. vocabulary grammar, together constituting the linguistic 
factor) are not systematically higher than correlations between factors (e.g 
between vocabulary and sociolinguistics) . 



Tab«l 3.2 Corrttlationa b^twMn q[u«fltion formats and raadlng coaprahanaion 

factors 





standani 
multiple -i^noice 


rational 
m-c cloze 
(ot .80) 


guided 
summary 
(a .73) 


tradi- 
tional 
(a .71) 


recent 
(ot .61) 


1 linguistics 

1.1 voc. specific {ot .85) 

1.1 voc. general (a .82) 

1.2 gramjnar (ot .71-. 78) 


.38 
.38 


.54 

.46 


.40 
.30 


.46 
.46 


2 taxt structura 

(ot .79-. 86) 


.40 


.40 


.30 


.31 


3 sociolinguistics 

(a .53-. 59) 


.36 


.43 


.30 


.47 


4 stratagias 

4.1 word building 
(ot .56-. 60) 

4.2 meaning from context 
(ot .62-. 71) 


.34 
.39 


.40 
.55 


.29 
.30 


.47 
.37 



The above correlations are somewhat difficult to interprete and to compare 
because the corresponding tests vary in reliability. In the following table 
all correlations have been made comparable by correcting for attenuation, 
assuming that all tests would have been perfectly reliable. 

Where more than one reliability was known, because the same test had been 
administered in more than one group or experiment, the correction has been 
computed on the basis of the highest reliability, in order to give the most 
conservative estimates . 

The general findings are that reading comprehension factors show medium high 
correlations with all the question formats. When comparing the formats it 
becomes clear that the multiple-choice cloze consistently shows lower 
correlations than the other formats. But even within the same old multiple- 
choice format there are differences of the same order between the 
consistently higher correlations for the recent than for the traditional 
items . 



6 



5 



Tabel 3.3 Correlations between question formata and reading comprehenaion 

factors corrected for attenuation 





standard 
multiple- choice 


m-c 
cloze 
(a .80) 


guided 
summary 
(a .73) 




tradi- 
iCL .71) 


recent 
(a .61) 


1.1 voc. specific (a .85) 

1.1 voc. general (a .82) 

1.2 grammar (a .71 -.78) 


.49 
. 51 


.76 
.67 


.48 
. 38 


. 58 
.61 


2 text structure 

(a .79-. 86) 


.51 


. 55 


.36 


. 39 


3 sociolinguistics 

(a .53-. 59) 


.56 


.72 


.44 


. 72 


4 strategies 

4.1 word building 
(a .56-. 60) 

4.2 meaning from context 
(a .62-. 71) 


.52 
.55 


.66 
.84 


.42 
.40 


.71 
. 51 



4 Conclusions and discussion 

The analysis of our specially constructed tests of a variety of factors 
showed that they were well designed. Their medium intercorrelations show that 
they succeeded in measuring different factors. The use of latent correlations 
has proved expedient because these are free from the usual attenuation 
effect. The pattern of correlations clearly distinguished between reading 
comprehension and other factors The data didn't allow statements about the 
hierarchy of reading factors. 

The main questions were: which reading comprehension factors are tested by 
the two types of multiple choice items, and is there any difference with 
experimental guided summaries? 

As it turns out, all three question types seem to test all reading 
comprehension factors, each testing them all in more or less the same degree. 
There is a difference between multiple- choice cloze and the other formats, 
which all have consistently higher correlations. This might be due to the 
novelty of this format, causing pupils to use all sorts of test taking 
strategies. The higher correlations for the guided summary seem to plead 
against this hypothesis. But then this format shows much more likeness to the 
usual question: What is it this paragraph roughly tells us?. 

For the test constructors is certainly is reassuring to know that their 
questions, however formatted, do test a broad range of reading comprehension 
factors . 
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SAMPLES OF TESTING MATERIAL 



Thm linguistic con^ponent: gracmar 



7 Welke van deze twee beweringen is waar? 

I have known men far more able than Bowles, but not half 50 interesting, which 
is quite a different thing. ... 

1 'whi'ch' slaat terug op 'far more able'. 

2 'which' slaat terug op 'not half so interesting'. 
A geen van beide is goed 

B alleen 1 is goed 
C alleen 2 is goed 
D zowel 1 als 2 is goed 

10 Welke zin is goed? 

1 What is new is the unexpected rapidity with which genes that confer resistance 
are spreading throughout the world. 

2 Which is new is the unexpected rapidity with which genes that confer 
resistance are spreading throughout the world. 

A geen van beide is goed 

B alleen 1 is goed 

C alleen 2 is goed 

D zowel 1 als 2 is goed 



15 Welke zin is goed? 

1 Fortunately, I knew all the answers. 

2 I knew fortunately all the answers. 
A geen van beide is goed 

B alleen 1 is goed 
C alleen 2 is goed 
D zowel 1 als 2 is goed 

19 Welke zin is goed? 

1 Would you mind opening the window? 

2 would you mind to open the window? 
A geen van beide is goed 

B alleen 1 is goed 
C alleen 2 is g ,ed 
D zowel 1 als 2 is goed 



26 Welke zin is goed? 

1 Mary didn't know the correct answer, and Michael did not either 

2 Mary didn't know the correct answer, and so did Michael. 
A geen /an beide is goed 

B alleen 1 is goed 
C alleen 2 is goed 
D zowel 1 als 2 is goed 



29 Welke zin is goed? 

1 I often watch TV, when I am tired 

2 I am often watching TV, when I am tired 
A geen van beide is goad 

B alleen 1 is goed 
C alleen 2 is goed 
D zowel 1 als 2 is goed 
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Thm linguiitic coxqponent: vocabulary 



59 to scatter = 

A protesteren 
B schaden 
C schetteren 
D verspreiden 

60 stamp = 

A St am 
B stampei 
C stank 
D stempel 



61 strenuous = 

A energiek 
B moeizaam 
C ijverig 



62 subsequent = 

A ondergeschikt 
B volgend 
C volgzaam 
D voorafgaand 



63 superstitious = 
A arrogant 
B bijgelovig 
C hoogstaand 



64 susceptible = 
A gretig 
B meevoelend 
C ondernemend 
D ontvankelijk 



65 to swallow « 
A opzwellen 
B slikken 
C uitwijken 
D vliegen 



66 tedious = 
A ordelijk 
B uitvoerig 
C verve lend 

67 treasury = 
A belasting 
B saldo 

C schatkist 
D schattig 



68 trunk = 
A booms tam 
B rotstreek 
C stommeling 
D trommel 



Thm textual conponant 

Huaan infants 

1 1 When a human infant is born into any community in an/ 

2 part of the world it has two things in common with any other 

3 newborn human infant, 8 neither of them has been 

4 damaged in any way either before or during birth. 9 

5 new born children are completely helpless. There is nothing 

6 the new born child can do to ensure its own survival apart 

7 from drawing attention to its helplessness by using sound. 

8 10 without care from rome other human being or beings, be it 

9 mother, grandmother, sister, nurse, or human group, a child 
10 is very unlikely to survive. 

2 11 This helplessness of human infants is in marked 

12 contrast with the capacity of many new born animals to get to 

13 their feet within minutes of birth and run with the herd 

14 within a few hours. 11 the human infant, young animals 

15 very quickly develop the capacity to fend for themselves, 

16 although they are certainly at risk, sometimes for weeks or 

17 even months after birth. 12 a long period of 

18 vulnerability is the price that the human species has to pay 
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19 for the very long period which fits man for survival as 

20 species. 

21 It is during this very long period in which the human 

22 infant is totally dependent on others that it reveals the 

23 second feature which it only shares with all other undamaged 

24 human infants, a capacity to learn language. 13 

25 biologists now suggest that language is 'species specific' to 

26 thQ human race that is to say, they consider the human infant 

27 to be genetically programmed in such a way that it can 

28 acquire language. This suggestion implies that just as human 

29 beings are designed to see three-dimensional ly and in colour, 

30 and 14 they are designed to stand upright rather 

31 than to move on all fours, so they are designed to "i earn and 

32 use language as part of their normal development as well- 

33 formed human beings. 

naar Anne and Peter Doughty, Lancruage and Community . Edward 
Arnold, London 1974) 



8 A although 

B because 

C provided that 

9 A Also 

B Nevertheless 

C On the other hand 

D To begin with 

10 A Even 

B Nevertheless, 

C So 

11 A Apart from 

B Compared with 

C Much like 

Put Che f ragmen cs in che right order. 



12 A It is not certain hat 
B It would seem that 

C This clashes with the fact that 

13 A Moreover, 
B However, 

C Therefore , 

14 A although 

B because of the fact that 

C just as 



A I entered through a heavy glass door, made two left turns, 
and was in the gallery. 

B I approached the fine arcs building under a grey, depressing 
sky. 

C Displayed on its walls were the paintings that made up the 

"Private Worlds" exhibit. 

D There my feelings of depression increased, because I seemed 
drawn again and again to the paintings that to me symbolized 
death. 

E Its metal work did not reflect sunlight that day; I had the 
impression that the building was as barren and deserted as 
the surrounding ground. 
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26 What is the first fragment? 

27 What is the second fragment? 

28 What is the third fragment? 

29 V.hat is the fourth fragment? 

30 What is the fifth fragment? 



Smnpl* of th« t«8t of th« sociolinguisti; component 

1 What sort of reading public does In These Times aire at, judging 
from the two advertisements below? 
A Socially engaged people. 
B Upper-class people. 
C Young intellectuals. 



Text 1 



Subscrlbt to 



'»t9k>t (WOO 
V MO 00 




OK^ia Ui one* 
on «l t^W*>M« «M*t w*^ I 




•O* V«OO0 



2 Judging from text 2, what can be said about the writer's 

attitude towards doctors? 
A He does not have a high opinion of them. 
B He feels sorry for them. 
C He looks up to them. 



Text 2 Doctors, of course, are men of confidence and not a little self - inport«nc«, 

accustomed to a special place in society, to a special regard from the rest of us who 
are not members of the magic circle. Nou that elitism is out of fashion, they are 
feeling the pinch. 
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Text 3 could have been taken from 
A a humorous article analysing driving behaviour. 
B an advertisement for Humber cars, 
C a report on dangerous driving. 



Text 3 



Imagine an Englishman driving along in his Ford Cortina. He looks in his 
mirror and sees a Hurber Super Snipe coming up behind him. This is not to him merely 
a faster, more powerful car. It is a noblemen trying to impress on him that he is a 
peasant. The Humber driver sounds his horn. Again, this is not to the Ford Cortina 
driver merely a simple connunication ard warning - the only one possible in the 
circunstances - that the Hunbcr is about to pass. It is a nobleman using, typically, 
perenptory and arrogant language to a peasant. There can be only one response to such 
abuse. The Cortin^driver veers to the crown of the road. And stays there. 



Saapl* o£ t«st X o£ co]qp«n«ation stratagias: word building 



4 bold = dapper 
embolden = 

A aanmoedigen 
B heldendom 
C ontmoedigen 

5 burden = last 
burdensome = 

A belasting 
B lastig 
C ontlast 
D opgelegd 

6 burden = last 
unburden = 

A belasten 
B ont laden 
C op zich nemen 

7 capsule = omhulsel 
encapsulation = 

A inkapseling 
B onthulling 
C uitbraak 



8 chaplain = geestelijk verzorger 
chaplaincy = 

A ambt van geestelijk verzorger 
B geestelijk verzorger in 

opleiding 
C salaris van geestelijk verzorger 
D voormalig geestelijk verzorger 

9 combat = gevecht 
combatant = 

A slagveld 
B slachtoffer 
C strijder 

10 continue = voortzetten 
discontinuance = 
A aanvang 
B beeindiging 
C uiteenzetting 
D voortzetting 



SanpXe of teat B of companaation 8tratagi«a: meaning from contaxt 

Instruction : 

Choose the alternative that gives the best meaning for the underlined 
word within its sentence. 



Margaret Thatcher has ooched Enoch 
Powell from the popularity polls 
conducted annually at Madame 
Tussaud's waxworks by finishing 
fifth in the political section. 



A gekozen 
B ontslagen 
C verdrongen 
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2 Even m a century which has goiled 
Itself on atrocities until it has 
become almost too full to swallow 
more, the horrors which accompanied 
and have followed the fall of 
Cambodia to the communists are 
exceptional . 

3 Commander Bob Bryan is a man with a 
mission: to make most people in 
London think that the capital's 
police are wonderful. It is a 
difficult job at a time when crime 
figures are rocketing, when an 
immigrant population blames the 
police for much of its problems with 
an anger that has culminated in 
riots, and when young people are 
showing more and more starp for the 
law. 



heeft zich mogen 
verheugen in 
zich heeft 
volgestopt met 
zich vol walging 
heeft afgekeerd van 



A bezorgdheid 

B ontzag 

C minachting 



A warning that the Government might 
have to conf it garages by law to 
display clearer information on 
petrol prices wan given last night 
by Mr Fraser, Minister of State for 
Prices and Consumer Protection. 
He said that not enough filling 
stations were obeying the voluntary 
agreement reached in September to 
make prices immediately intelligible 
to the passing motorist. 



A mogelijk maken 
B verplichten 
C vri jstellen 



A broken toe did not brank Robin 
Cousins from taking a commanding 
lead at Richmond Ice Rink yesterday, 
when the British men's figure 
skating championship began. Last 
month he stubbed his little toe 
against his bedroom furniture, and 
this caused him anxious weeks during 
which his foot was too swollen to 
get into his boot. 



A beschermen tegen 
B vrijstellen van 
C weerhouden van 



Sasiple standard multiple-choice 1: old typa 



1 No one knows how children learn to read: how they master 

2 the mammoth code-breaking task of matching spoken language to 

3 a series of small black marks on a page. 

4 Until now, teaching children to read has been a very hit 

5 and miss affair. More than any other area of the school 

6 curriculum, reading has attracted a mass of schemes and 

7 gimmicks designed to get children painlessly over the hurdles 

8 which bar their way to school learning and professional 

9 3uccess. Like freely available medicines, some of the goods 

10 are sounder than others? they work for some children and 

11 teachers, earning their promoters a fortune, while others 
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12 sink without trace. Each new broadening of education, from 

13 the arrival of printing and of Bibles in the mother tongua in 

14 the 15th century to the introduction of universal, compulsory 

15 education in the 19th, has boosted the market. 

3 16 Some children scarcely seem to need all these 

17 paraphernalia, learning to read almost imperceptibly. Others 

18 defy for years all the efforts of teachers armed with reading 

19 schem,es and flashcards, plastic letters and coloured bricks. 

20 Most manage to crack the basic code by about seven or eight, 

21 but too many, perhaps as many as 20 per cent, fall at the 

22 next hurdle: the ability to use their skill as a means of 

23 gaining knowledge and enjoyment. In the last year new lights 

24 has been shed on this old mystery. Like pieces of a jigsaw, 
2 5 research studies set up several years ago - because of 

26 national anxiety at levels of illiteracy - have been brought 

27 together to yield a picture that has revolutionary 

2 8 implications both for parents and primary school teachers. 

4 2 9 Extending Beginning Reading by Vera Southgate, 

30 Helen Arnold and Sandra Johnson confounds many dearly-held 

31 beliefs. In particular, the authors foxind that teachers who 

32 try to hear all children read aloud frequently, hinder their 

33 progress, 'hildren learn best if left in peace to read the 

34 books they choose for themselves. Learning to read is so 

35 highly personal a business, it depends so much on groxindwork 

36 before the age of five and the opportunity to practice at 

37 home and in private, that much of the work must be done by 

3 8 parents. 

5 39 Such a message, while it may seem a welcome dawn of 

40 common sense to many parents, is deeply threatening to mjtny 

41 teachers. They are being asked to change from pedagogues to 

42 managers and counsellors, advising parents and children, 

4 3 diagnosing weaknesses, sorting out appropriate remedies, 

44 organising teaching materials, stimulating and encouraging. 

6 4 5 It is when this study is set alongside another carried 

46 out under the guidance of the late Professor Jack Tizard in 

47 Haringey that the full nature of the revolution becomes 

48 apparent. Still not published in full, the Haringey study of 

4 9 children aged between six and nine showed that they made most 

50 progress in reading when their parents heard them read at 

51 home at least three or four times a week. The effects were 

52 dramatically better than if parents simply read to their 

53 children or played with and talked to them. By contrast, 

54 providing extra reading help in school with a specialist 

5 5 teacher four afternoons a week was found to be almost totally 
56 ineffective . 

7 57 There is, of course, nothing new about parents helping 

58 children at home. What is new is the official blessing for 

59 such activities. The Bullock report (1975) specifically 

60 warned against parents giving formal help at home. The 

61 education world is beginning to realise that parents must be 

6 2 taken into partnership in a much more thorough way than 

6 3 anything envisaged by the average parent/teacher association. 

64 The days are over when teachers could say to parents, 'you 

6 5 teach them to tie their laces and go to the toilet on their 

66 own and we will do the rest. ' 



The Observer Magazine, September 13, 1981 
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19 What does the writer say in the first paragraph about learning to 
read? 

A It is a decisive stage in a child's development, 
3 It is a difficult and mysterious process. 

C It is an activity that is not really suitable for young children. 
D It opens up the world of books to children. 

20 'teaching children to read has been a very hit and miss affair' 
(lines 4-5) . What does this mean? 

A Reading methods have caused pupils a lot of unnecessary worry. 
B Reading methods have cost schools a lot of money. 
C The approach to teaching reading has not been very methodical up 
till now. 

D There have been many violent disputes among educators about how 
to teach reading. 

21 What is meant by 'others sink without trace' (lines 11-12)? 
A Some children soon seem to forget what they have learnt. 

B Some course writers have failed to find a publisher. 

C Some reading courses are not at all successful. 

D Some teachers fail to teach their pupils how to read. 

22 What is said about 'Each new broadening of education' (line 12)? 
It has increased 

A the amount of money spent by the Government on education. 

B the demand for educational materials. 

C the number of pupils attending schools. 

D the number of subjects taught. 

23 What do lines 16-17 ('Some ... imperceptibly.') come down to? 
Some children 

A do not seem to have any difficulty in learning to read, 

B have to use teaching aids they do not like much. 

C need their teachers' special attention when learning to read. 

D only play, failing to learn anything. 

24 What IS 'this old mystery* (line 24)? 
Why it is that 

A people continue to expect so much from teaching aids. 
B reading becomes a handy tool to some but remain a useless one to 
others . 

C so far a method combining instruction and enjoyment has not been 
found. 

D the same methods of teaching reading have always been used for 
all pupils. 

?5 Why were 'research studies set up several years ago' (line 25)? 
A Because of the declining interest in English literature. 
B Because of the large numbers of people unable to read or write. 
C To bring together the ideas parents and teachers have about 
reading . 

D To investigate existing ideas about teaching children to read. 

26 What IS said about 'Extending Beginning Reading' (line 29)? 

A It has excited great enthusiasma among teachers 

B It has given support to the theories of many teachers 

C It has killed the enthusiasm of many teachers 

D It has overthrown many traditional convictions among teachers 
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27 Why is 'Such a message' (line 39) deeply threatening to many 
teachers? 

A It involves a lot of extra work after school hours. 
B It will mean a complete change in their educational role. 
C Their educational qualifications are questioned. 
D They are expected to devote too much time to the individual 
pupil . 

29 What IS important for children in learning to read, according to 
Professor Tizard? 
A Encouragement instead of criticism. 
B Expert help in case of problems. 
C Reading to their parents regularly. 
D The example set by their parents. 

2 9 What important development in education is pointed out in 
lines 57-66? 

A Parents and teachers are expected to cooperate more closely by 

foirming one association. 
B Parents are now actually invited to take an active part m 

classroom work. 

C Parents are now given a say in deciding what is to be taught at 
school . 

D Parents helping their children with school subjects is now 
officially approved. 

Sftmpltt standard multlpla-choica 2 racant typa 



1 1 Dear Sir, 

2 The suggestion that leukaemia around nuclear reprocessing 

3 facilities in the UK is the result of a large population 

4 influx bringing an unidentified viral agent infecting a 

5 susceptible community is reported by your medical editor, 

6 Oliver Gillie, as if it were fact rather than speculation (9 

7 December) . There ar:3, however, a number of major flaws in 

8 this hypothesis. 

2 9 First no virus has yet been identified. Second, the 

10 excess leukaemias at Dounreay occurred more than 2 0 years 

11 after the plant started operations, whereas the viral 

12 hypothesis demands that the excess occurred early on. At 

13 Sellafield, cases of both leukaemia and lymphoma have been 

14 seen throughout the period of observation, and show no signs 

15 of diminishing. Finally, even though children who developed 

16 leukaemia were born in Seascale, most of the families had 

17 moved to the area, and were not part of the indigenous 

18 population. 

3 19 These observations do not exclude the viral hypothesis, 
2 0 but they render it much less plausible, at least as far as 

21 Sellafield and Dounreay are concerned. 

22 Yours faithfully, 

23 Dr Robin Russell Jones 

24 SCO-fee Poges, Buckinghamshire 



'The Independent' . December 12, 1988 
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19 What 'hypothesis' (line 8) is meant? 

A Leukaemia around nuclear power plants is clearly linked up with 

the emissions of nuclear power plants. 
B Leukaemia in areas with nuclear power plants is caused by a virus 

passed on to people with little resistance to it. 
C Leukaemia is caused by a virus in the atmosphere surrounding 

nuclear power plants. 

20 What conclusion does Dr Russell Jones reach in his letter? 

A It is high time the population around nuclear plants is helped to 

resettle elsewhere. 
B The available facts seem to support the viral hypothesis. 
C The viral hypothesis cannot take away suspicions about a -relation 

between leukaemia and nuclear reprocessing. 



Smmplm rational multipla-choica cloza 



1 No one knows how children learn to read: how they master 

2 the mammoth code-breaking task of matching spoken language to 

3 a series of small black marks on a page . 

4 Until now, 32 children to read has been a very hit and 

5 miss affair. More than any other area of the school 

6 curriculum, reading has attracted a mass of 33 and gimmicks 

7 designed to get children painlessly over the hurdles which 

8 bar their way to school learning and professional success. 

9 Like freely available medicines, some of the goods are 34 

10 than others; they work for some children and teachers, 

11 earning their promoters a fortune, 35 others sink without 

12 trace. Each new 36 of education, from the arrival of 

13 printiiig and of Bibles in the mother -ongue in the 15th 

14 century to the introduction of universal, compulsory 

15 education in the 19th/ has boosted the market. 

16 Some children sfcarcely seem to need all these 

17 paraphernalia, learning to read almost imperceptibly. 37 

18 defy for years all the efforts of teachers armed with reading 

19 schemes and flashcards, plastic letters and coloured bricks. 

20 Most manage to crack the basic code by about seven or eight, 

21 but too many, perhaps as many as 20 per cent, 38 the next 

22 hurdle: the ability to use their skill as a means of gaining 

23 knowledge and enjoyment. In the last year new light has been 

24 shed on this old mystery. Like pieces of a jigsaw, research 

25 studies set up several years ago - because of national 39 

26 at levels of illiteracy - have been brought together to yield 

27 a picture that has 40 implications both for parents and 

28 primary school teachers. 

29 Extending Beginning Reading by Vera Southgate, 

30 Helen Arnold and Sandra Johnson confounds many dearly-held 

31 41 In particular, the authors found that teachers who try 

32 to hear all children read aloud frequently, 42 their 

33 progress. Children learn best if left in peace to read the 
34. books they choose for themselves. Learning to read is so 

3 5 highly 43 a business, it depends so much on groundwork 

36 before the age of five and the opportunity to practice at 

37 home and in private, 44 much of the work must be done by 

38 parents. 
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3 9 Such a 45 . while it may seem a welcome dawn of common 

40 sense to many parents, is deeply 46 to many teachers. They 

41 are being asked to change from pedagogues to managers and 47 

42 , advising parents and children, diagnosing weaknesses, 

4 3 sorting out appropriate remedies, organising teaching 
44 materials, stimulating and encouraging, 

4 5 It is when this study is set alongside another carried 

4 6 out under the guidance of the late Professor Jack Tizard in 

47 Haringey that the 48 of the revolution becomes apparent, 

48 Still not published in full, the Haringey study of children 
4 9 aged between six and nine showed that they made most 49 

50 reading when their parents heard them read at home at least 

51 three or four times a week. The 50 were dramatically better 

52 than if parents simply read to their children or played with 

53 and talked to them, 51 . providing extra reading help in 

54 school with a specialist teacher four afternoons a week was 

55 found to be almost totally ineffective. 

56 There is, of course, 52 about parents helping children 

57 at home. What is new is the official 53 such activities, 

58 The Bullock report (1975) specifically warned against parents 

59 giving formal help at home. The education world is beginning 

60 to realise that 54 must be taken into partnership in a much 

61 more thorough way than anything envisaged by the average 

62 parent/teacher association. The d-/s are over when teachers 

63 could say to parents, 'you teach them to tie their laces and 

64 go to the toilet on their own and we will do the rest, ' 

The Observer Magazine, September 13, 1981 



33 A expecting 
B forcing 

C teaching 

34 A inve s ttien t s 
B languages 

C results 
D schemes 

35 A cheaper 

B more expensive 
C newer 
D sounder 

36 A because 
B so that 
C while 

3 7 A broadening 
B control 
C cut 

D normalising 

38 A Experts 

B Others 

C Parents 

D They 



39 A consider 
V fall at 
C get over 
D ignore 

4 0 ii. anxiety 
B attempts 
C indifference 
D pleasure 

41 A few 

B negative 

C revolutionary 

D unfair 

42 A authors 
B beliefs 
C children 
D wishes 

43 A aim at 

B encourage 
C hinder 
D mark 

44 A collective 
B important 
C personal 
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45 


A 


although 


3 u 


A ans we r s 




B 


because 




B circumstances 




C 


even if 




C effects 




D 


that 




D relationships 


46 


A 


educating 


51 


A As a result 




B 


exciting 




B At any rate 




C 


satisfying 




C By contrast 




D 


threatening 




D For example 


47 


A 


counsellors 


52 


A great anxiety 




B 


drillmasters 




B nothing likely 




C 


experts 




C nothing new 




D 


professionals 




D some doubt 


48 


A 


full destruction 


53 


A blessing for 




B 


full nature 




B rejection of 




C 


ins igni f icance 




C research into 










D reserve towards 


49 


A 


mistakes in 








B 


objections to 


54 


A parents 




C 


progress in 




B publishers 



C pupils 
D teachers 



Guld«d flusnary task: task and marking scham* 

In dc tcksC geefc dc schri]vcr zijn mcnmg over voorlichtmgsprogranm*' s over gezondhcid. 
L«C3 dc tek3t door, let op de hootdzaken ervan, Schenk nice ce veel aandacht aan onbekcndc 
woorden . 

MaaJc een samenvattmg m hct Nedcz lands van maximaal 150 woorden. Hierin moezen achcerscnvolgcns 
de volgende punten m hun onderiinye samenhang aan de crde koaten: 

menmg: 

ettrste arguaienc/ 
tweede argument; 
onderbouwmg tweede argument ; 
conclusie . 

Ueem telkcns het trefvoord over op je papier en vat hez bijbehorende tekstgcdeelte samen. Maak 
vollediqe zinnen. 

Tel al9 )e klaar bent het aantal woorden en schrijf dat ondcr }C samcnvatt mg. 
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Corr«cti«voor«chri£t bij HMlth. happin*** and a long lif« 



Ir.f ormatie-elentent 



Voorbeeldsamenvattinq 



■•ning 



I- 



De schri^ver is van meninq dat de 
aangekondigde voorlichtings- 
prograntfna's over gezondheid zinloos 
zijn / lemands gedrag met kurmen 
beinvloeden 

omdat ze te eenzi^dig / te 
simpliscisch zi]n 



Je schri^ver is van mening dat de 
voorlichtingsprogramma's over gezondheid 
verkeerd zi^n, omdat ze te eenzijdige 
richtli^nen geven. 



••rat* 

argument 



De feiten wi^zen uit dat minder eten 
en roken geen merkbaar effect cp de 
gezondheid heeft. 

{ 



Oat IS ook de mening van somnige artsen. 
Deze zi]n het er met mee eens dat mensen 
die minder eten en drinken nander kana op 
dodeli]ke hartaanvallen hebben. Dat is uit 
ondersoek gebleken. 



arguM&t 



Ri.chtli]nen voor gezond leven leiden 
met tot meer levensgeluk. 



Volgens Irma Kurtz geloven menaen ten 
onrechte dat een goede lichaamsverzorging 
tot groter gcluk leidt, want een goede 
conditie heeft volgens haar niets te maken 
met hoe menaen met elkaar omgaan. 



ondttrbowri ng 
2^ «rg. 



Want medische richtli^ner hebben met 
te maken met relaties tot andere 
•nenaen . 



De aangekondigde 

gezondheidsprogramma's voldoen met. 



Voorlichtmgsprogramma ' s die geen rekemng 
houden net andere bronnen van gezondheid en 
geluk zullen weinig effect hebben. 



Voor Am juiat^ infaoud van •Ik informati^-^l«Miit *K>rdt 1 punt to*g^k«ndf 

voor d^ juiflt^ plaataing van •Ik in£orMtU-^l*Mnt wordt ook 1 punt to«9^k«nd. mMximmmcorm 

±m dua ( X 2 - 12 punt«n. Blj ••n total* l^ngt* van — •«; dan ISO wDord*n word*n 2 aeor*punt«n in 
■Indaring gabracht. 
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